Papers with Inhibition Control
MICo: Preventative Detoxification of Large Language Models through Inhibition Control (2024.findings-naacl)
Copied to clipboard
Roy Siegelmann, Ninareh Mehrabi, Palash Goyal, Prasoon Goyal, Lisa Bauer, Jwala Dhamala, Aram Galstyan, Rahul Gupta, Reza Ghanadan
| Challenge: | Large Language Models (LLMs) have a tendency to devolve into toxic degeneration . model may classify prompts as toxic or non-toxic and categorically refuse to respond to those deemed toxic. |
| Approach: | They propose a mechanism for LLM detoxification by labeling acceptable and unacceptable examples and including a corresponding acceptable rewrite with every unacceptable example. |
| Outcome: | The proposed model improves on the baseline model and shows that it detects and rewrites toxic and harmful examples. |